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Abstract 

The configuration model is the most natural model to generate a random multi- 
graph with a given degree sequence. We use the notion of dense graph limits to 
characterize the special form of limit objects of convergent sequences of configu- 
ration models. We apply these results to calculate the limit object corresponding 
to the dense preferential attachment graph and the edge reconnecting model. Our 
main tools in doing so are (1) the relation between the theory of graph limits and 
that of partially exchangeable random arrays (2) an explicit construction of our 
random graphs that uses urn models. 



1 Introduction 

The notion of dense graph limits was introduced in [10] and has been further developed 
over the years, see ^ for a recent survey. Heuristically, the theory of dense graph limits 
gives a compact way to characterize the statistics of a randomly chosen small subgraph of 
a large dense graph. In [5J the graph limits of various sequences of random dense graphs 
were calculated and in this paper we proceed with the investigation of this topic. 

Our objects of study are multigraphs rather than simple graphs, i.e. we allow par- 
allel and loop edges: this choice makes the definition of the limit objects of convergent 
multigraph sequences {multigraphons) slightly more complicated than the limit objects of 



*ETH Ziirich, Department of Mathematics, Ramistrasse 101, 8092 Ziirich. 
Email: rathb@math.ethz. eh. 

'I'Eotvos Lorand University, Institute of Mathematics, Pazmany Peter setany 1/C, 1117 Budapest. 
Email: szakacsl@cs.elte.hu 

^Keywords: dense graph limits, multigraphs, configuration model, preferential attachment. 
MSC2010 classification: 05C80 (Random graphs) 



1 



simple graph sequences (graphons), but on the other hand the multigraph models defined 
below are easier to study than the corresponding simple graph models. 

The simplest way to generate a random multigraph with a prescribed degree sequence 
is called the configuration model: we draw d{v) stubs (half-edges) at each vertex v and 
then we uniformly choose one from the the set of possible matchings of these stubs. In 
this paper we call such random multigraphs edge stationary (for reasons that will become 
clear later) and in Theorem [T] we characterize the special form of limiting multigraphons 
that arise as the limit of random dense edge stationary multigraph sequences. Rougly 
speaking, our theorem states that the number of edges connecting the vertices v and w 
has Poisson distribution with parameter proportional to d{v)d{w). 

We also investigate two random graph models which have different definitions but 
turn out to have the same distribution: 

• The edge reconnecting model is a random multigraph evolving in time. Denote 
the multigraph at time T by Qn(T), where T = 0, 1, 2, . . . and n = |V(^„(T))| is 
the number of vertices. We denote by m = \E{Qn{T))\ the number of edges (the 
number of vertices and edges does not change over time). Given the multigraph 
QniT) we get QniT + 1) by uniformly choosing an edge in E{QniT)), choosing one 
of the endpoints of that edge with a coin flip and reconnecting the edge to a new 
endpoint which is chosen using the rule of linear preferential attachment: a vertex 

V is chosen with probability 2m+n « ' where d{v) is the degree of vertex v in ^„(T) 
and K G (0, +oo) is a flxed parameter of the edge reconnecting model. We look at 
the unique stationary distribution of this multigraph-valued Markov chain which is 
a random multigraph on n vertices and m edges. 

• In Section 3.4 of [5] a random multigraph called preferential attachment graph 
with n nodes and m edges (briefly PAG (n,m)) is deflned. We slightly generalize 
the definition to obtain 'PAG,^{n,m) where k G (0, +oo) is a fixed parameter: let 

V = {f 1, . . . , f„} be a set of vertices. We create a sequence vl, . . . , with elements 
from V by starting with the empty sequence and appending random elements of 

V one by one. If the current length of the sequence is L then we choose the 
next element v*i^j^i to be equal to v &V with probability 4+^' where d{v) is the 
multiplicity of v in the sequence f J', . . . , f^- Now we create the random multigraph 
VKG^iji.m) on the vertex set V by adding the edges of form {^2^-15 "^^2^;} ^^r each 
A; = 1, . . . , m. 

Lemma 12.11 states that the above described two random multigraphs have the same 
distribution. In Theorem [2] we give the limiting multigraphon of this random multigraph 
when — 00 and m ~ \p'n^i where p G (0, +00) is a fixed parameter of the model called 
the edge density. Roughly speaking, the limiting multigraphon can be described as fol- 
lows: it is edge stationary, and the rescaled degrees of vertices have Gamma distribution 
with parameters depending on n and p. 
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The precise statements of these theorems along with the necessary notations can be 
found in Section [21 We end the Introduction with mentioning a few related results: 

The configuration model is a random multigraph, but if we condition it to have no 
multiple and loop edges, then the resulting random simple graph is uniformly distributed 
given its degree sequence. In [6] the description of the limiting graphon of such sequences 
of simple dense graphs (and a continuous version of the Erdos-Gallai characterization of 
degree sequences) is given. 

In [13] we give a characterization of the time evolution of the edge reconnecting model, 
viewed through the prism of the theory of multigraphons: roughly speaking, if we start 
the edge reconnecting model from an arbitrary initial multigraph, then we have to run our 
process for in? <^T steps until QniT) becomes "edge stationary" and run it for in? <^T 
steps until QniT) becomes "stationary". 
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2 Notation and results 

Denote by No = {0, 1,2,...}, [n] := {1, . . . , n} and [k..n] := {k, . . . , n}. If Hi and H2 
are arbitrary sets, denote by / : Hi --^ H2 a. generic injective function from Hi to H2. 
Denote by the set of undirected multigraphs (graphs with multiple and loop edges) 
and by M.n the set of multigraphs on n vertices. Let G G Ai„. The adjacency matrix of 
a labeling of the multigraph G with [n] is denoted by (-B(^, j))"j=i, where B{i,j) G Nq 
is the number of edges connecting the vertices labeled by i and j. B{i,j) = B{j,i) since 
the graph is undirected and B{i,i) is two times the number of loop edges at vertex i 
(thus B{i,i) is an even number). 

We denote the set of adjacency matrices of multigraphs on n nodes by An, thus 

An = {5gN[}^'^ : B^ = B,^ie [n] 2\B{i,i)]. 

The degree of the vertex labeled by i in G with adjacency matrix B G An is defined 
by d{B,i) := ^"=i-B(^, j), thus d{B,i) is the number of stubs at i (loop edges count 
twice). Let 

^ n 1 ^ 

m = m{G) = m{B) = -J^ B{i,j) = -Y,d{B,i) 

i,j=l i=l 

denote the number of edges. Denote by A^ the set of adjacency matrices on n vertices 
with m edges. 
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An unlabeled multigraph is the equivalence class of labeled multigraphs where two 
labeled graphs are equivalent if one can be obtained by relabeling the other. Thus 
Ai is the set of these equivalence classes of labeled multigraphs, which are also called 
isomorphism types. 

Suppose F E Aik, G E Ain and denote hj A E Ak and B G An the adjacency 
matrices of F and G. If g : Ai ^ M. then we say that g is a multigraph parameter. Let 
g{A) := g{F). Conversely, if g : IJfcli -^fc — t- M is constant on isomorphism classes, then 
g defines a multigraph parameter. 

2.1 Multigraphons and multigraph convergence 

We define the induced homomorphism density of F into G by 

t={F,G):=UA,B):=^ l[yt,je[k]:A{t,j) = B{^{^,v{j))]. (1) 

ip:[k]^[n] 

The notion of convergence of simple graph sequences and several equivalent character- 
izations of graphons (limit objects of convergent graph sequences) were given in [10]. In 
[8] a natural generalization of the theory of dense graph limits to multigraphs is given (see 
also [T2] for similar results in a more general setting). We say that a sequence of multi- 
graphs {Gn)'^^i is convergent if for every A; G N and every multigraph F e Aik the limit 
g{F) = lim„_j.oo t={F, Gn) exists, moreover we have YliA^Ak 9^^) ~ ^- "^^^ limit object of 
a convergent multigraph sequence is a measurable function W : [0, 1] x [0, 1] x — ^ [0, 1] 
satisfying 

oo 

W{x,y,k) = W{y,x,k), ^ Vr(x, A;) = 1, W{x,x,2k + I) = Q. (2) 

fc=0 

Such functions are called multigraphons. For every multigraphon W and multigraph 
F E M.k with adjacency matrix A G Ak we define 

t={F,W):=t={A,W):= [ TT W{x,, x,, A{i,j)) dxidx2 ... dxk (3) 

We say that Gn ^ W if for every k eN and every F G A^a: we have 

lim t={F,Gn)=t={F,W). 

Theorem 1 of [8j states that if a sequence of multigraphs (Gn)^^ is convergent then 
Gn — > W for some multigraphon W and conversely, every multigraphon W arises this 
way. The limiting multigraphon of a convergent sequence is not unique, but if we define 
the equivalence relation Wi = W2 hy W F E M : t={F,Wi) = t={F, W2) then obviously 
Gn — >■ M^i, Gn — W2 implies Wi = W2. For other characterisations of the equivalence 
relation = for graphons, see 0]. 
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For a multigraphon W and x G [0, 1] we define the average degree of W at x and the 
edge density of W by 

„1 oo 

DiW,x) := / ^A;-H^(x,y,A;)dy, (4) 
-^0 fc=0 

„1 „i oo 

p{W):= / / ^A;- Vr(x,i/,A;)d?/dx. (5) 

Jo Jo fc^o 



If p(W) < +00 then x) < +oo for Lebesgue-almost all x. 

Given a multigraphon W we define the degree distribution function of W by 



Fw{z) = [ l[D{W,x) <z]dx, z>0. (6) 

Indeed, -FW(-) is a probability distribution function on [0, oo), i.e. it is nonnegative, right 
continuous, increasing and satisfies lim^^^oo Fw{z) = 1. It is easy to see that we have 
p(W) = J^zdFwiz). Denote by 

F^^(m) := mm{z : Fw{z) >u}, ue (0, 1). (7) 

2.2 Random multigraphs and random adjacency matrices 

We denote a random element of An by X„. We may associate a random multigraph Qn 
to X„ by taking the isomorphism class of X„. 

We say that a sequence of random multigraphs (^n)^^ converges in probability 

to a multigraphon W (or briefly write Qn W) if for every multigraph F we have 
t={F,gn)^t={F,W),i.e. 

\/F eMye>0: lim P(|t=(F,^„) -t=(F,iy)| > £) = 0. (8) 

n— ^oo 

We say that X„ — ^ W if Qn — ^ W holds for the associated random multigraphs. 

Note that the definitions of the edge reconnecting model and the PAG^ (see Section 
[1]) in fact naturally give rise to a random labeled graph, i.e. a random element X„ of An- 
The edge reconnecting Markov chain is easily seen to be irreducible and aperiodic on the 
state space A^, thus the stationary distribution is indeed unique. 

We say that the distribution of X„ is edge stationary if the conditional distribution 
of X„ given the degree sequence ((i(X„, i))"^^ is the same as that of the configuration 
model (see Section [1]) with the same degree sequence. 

Recall the formulas defining the Poisson and Gamma distributions: 

p{k,X):=e-'^ (9) 

OCX — I3x 

g{x,a,f3) := x^^-^'^-^llx > 0] (10) 
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We say that a nonnegative integer-valued random variable X has Poisson distribution 
with parameter A (or briefly denote X ~ POI (A)) if P (X = A;) = p{k, A) for all G N. 
We say that a nonnegative real-valued random variable Z has gamma distribution with 
parameters a and (3 (or briefly denote Z ~ Gamma(Q;, /?)) HP {Z < z) = g{x, a, (3) dx. 
For a real-valued nonnegative random variable X define 

E(X;m) := E(X ■ \[X > m]) . 



2.3 Statements of main results 

First we state our theorem characterizing the form of multigraph limits of edge stationary 
multigraph sequences: 

Theorem 1. Let W denote a multigraphon with p(W) < +oo. If is an An-valued 
edge stationary random variable for all n G N, X„ — > W for some multigraphon W , 
and the sequence (X„)^^ satisfies 



lim supy^ V E(X„(i,j);m) = (11) 

V^/ i<]<n 
1 

lim sup- VE(X„(i,i);m) = 0, (12) 



then the limiting multigraphon W can be rewritten in the form W = W where 

W{x,y,k) := { ^^z! F,-:}(x)F-}M\ (13) 



l[2\k].p[l,^^^^) ^fx = y 



Now we state our results describing the multigraph limit of the PAG K{n,m) and the 
stationary distribution of the edge reconnecting model. 

For an adjacency matrix B G An denote by m'{B) = J2^=i Sj=i-^(*)i) ^he number 
of non-loop edges of the corresponding graph. 

Lemma 2.1. The unique stationary distribution of the edge reconnecting model with 
linear preferential attachment parameter k, and state space A^ has the same distribution 
as PAG i^{n, m) . If^n has this distribution then for all B G A^ 



PfX. 



B) 



nr=in 



K + J-1) 



m 



B{i,i) 



(14) 
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At the end of Section 3.4 of the following theorem is stated: 
Let SPAG(?2, m) denote the simple graph obtained from PAG(n, m) by deleting loops 
and keeping only one copy of the parallel edges. Then 

SPAG(^n,y ■(p + o(l))^ -^Ws, := l-exp(-pln(x)ln(|/)), (15) 

where (analogously to ([S])) the symbol — ^ denotes convergence in probability of a se- 
quence of random simple graphs to a (simple) graphon. 

It is easy to see that (|T5l) is a corollary of the following theorem: 

Theorem 2. Let us fix k, p G (0,+oo). // is a random element of A!^^^^ with 
distribution (fUjl for n = 1,2, ... , moreover the asymptotic edge density is 

2m(n) 
lim — = p, 

n—^oo n 

then X„ — ^ W where 

^- = I im.p (!,£»)) = , 

and is the inverse function of F{z) = g{y, k, ^)dy, see (fTOj) . 

Note the similarity of the multigraphons appearing in ( IT3|) and (|T6|) : as we will 
see later, this is a consequence of the fact that the distribution of PAG K{n,m) is edge 
stationary. 

The proofs of the above stated theorems rely on the following ideas: 

• We relate our random graph models to urn models with multiple colors (e.g. the 
well-known Polya urn model): the number of balls is 2m and they are colored with 
n possible colors. Each ball corresponds to a stub, each color corresponds to a 
labeled vertex and the edge set of the multigraph depends on the positions of balls 
in the urn. 

• We make use of the underlying symmetries of the distributions of our random graphs 
by relating the theory of graph limits to the theory of partially exchangeable arrays 
of random variables, a connection first observed in [?]. 

The rest of this paper is organized as follows: 

In Section [3] we introduce the notion of random, vertex exchangeable, infinite ad- 
jacency matrices as well as VT-random multigraphons and deduce some useful results 
relating the convergence of these objects to graph limits. 

In Section S] we relate the notion of edge stationarity to the ball exchangeability of 
the corresponding urn models and prove the convergence results stated above. 
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3 Vertex exchangeable arrays 



In this section we introduce random infinite arrays X = (^X{i,j)).^_^ that arise as 
the adjacency matrices of random infinite labeled multigraphs and we give probabilistic 
meaning to the homomorphism densities t={F,W) by introducing H^-random infinite 
multigraphs X^y. We also introduce the notion of the average degree -D(X, i) of a vertex 
i in an infinite, dense, vertex exchangeable multigraph. 

In Subsection 13.11 give a useful alternative characterisation of Qn — ^ W using ex- 
changeable arrays and prove that under certain technical conditions the average degrees 
of Qn converge in distribution to the average degrees D(Xw, i) of the limiting H^-random 
infinite array. 

Let denote the set of adjacency matrices j))°^.^-^of countable multigraphs: 

We consider the probability space (^n, ^i P) where J-" is the coarsest sigma-algebra with 
respect to which A{i^j) is measurable for all i,j and P is a probability measure on 
the measurable space (v4n,^). We are going to denote the infinite random array with 
distribution P by X = We use the standard notation X ~ Y if X and Y 

are identically distributed (i.e. their distribution P is identical on (^pj, J^)). 

If X is a random element of A^^ let X^'^l be the random element of Ak defined by 

XW:=(X(^,j)t=i- 

Definition 3.1 (W^-random infinite multigraphons) . Let {Ui)°l^ be independent random 
variables uniformly distributed in [0,1]. Given a multigraphon W we define the ran- 
dom countable adjacency matrix X.w = {Xw{i, as follows: Given the background 
variables {Ui)'^i the random variables {Xw{i, o^re conditionally independent and 

P j) = m I mZi) = W{U„ f/„ m), 

that is if A E Ak then we have 

P (Xgl = A I (f/,)~,) := n W{U,,U„A{z,j)). (17) 

i<j<k 

In plain words: if i ^ j and Ui = x, Uj = y then the number of multiple edges 
between the vertices labeled by i and j in X^y has distribution (W{x^y^ 
number of loop edges at vertex i has distribution (W{x, x^2k)^'^__^ (these are indeed 
proper probability distributions by ([2])). 

For every multigraphon W and multigraph F E Aik with adjacency matrix A G Ak 
we have 

t={F,W)^^p(x^S = A). (18) 
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Recalling and we have 

D{W, x) = E {Xw{l, 2)\U, = x), p{W) = E {Xw{l, 2)) . (19) 

If p(W) < +00 then D(W, Ui) < +00 almost surely. 

We say that a random infinite array X = {X{i, j))'^-^^ is vertex exchangeable if 

(^(rW,r(j)))°:;=i~(X(^,j))S=i (20) 

for all finitely supported permutations r : N — )■ N. We call X = j))'^-^^ dissociated 
if for all m, n G N the valued random variable {X{i^ j))^ is independent of the 

^m-valued random variable (-^(^, j))"jir^+i- 

In our case an infinite exchangeable array can be thought of as the adjacency matrix 
of a random multigraph with vertex set N: the adjacency matrix of this random infinite 
multigraph is vertex exchangeable if and only if the distribution of the random graph 
is invariant under the relabeling of the vertices and dissociated if and only if subgraphs 
spanned by disjoint vertex sets are independent. 

It follows from Definition 13. II that X^^^ is vertex exchangeable and dissociated and by 
Aldous' representation theorem (see Theorem 1.4, Proposition 3.3 and Theorem 5.1 in 
[T]), the converse holds: a random element X of An is vertex exchangeable and dissociated 
if and only if X ~ X^y for some multigraphon W . Although the notion of the W- 
random graph (see Definition 13. ip is already present in [10], the connection of Aldous' 
representation theorem with the theory of graph limits was first observed in [7] . See also 
Theorem 3.1, Theorem 3.2, Proposition 3.4 of [TT]. For a self-contained proof of this 
representation theorem for multigraphons, see Theorem 1 and Theorem 2 in [5]. 

For a vertex exchangeable infinite array X satisfying E (X(l, 2)) < +00 we define the 
average degree of X at vertex i by 

1 " 

D(X,^):= hm -VX(^,J). (21) 

n-J-oo n 

The sum ^ X]j=i ^(^5 j) indeed almost surely converges to a random variable as n — )■ 00 
by de Finetti's theorem (see Section 2.1 of [2]) and the conditional strong law of large 
numbers. From (jlj). Definition 13.11 and (IT^ we get 

1 ^ 

D(Xh.,^)= lim -VXh.(z,j) =^(W^,^^0- (22) 
3.1 Convergence of exchangeable arrays 

In this subsection we state and prove two lemmas: in Lemma 13.11 we relate convergence 
of dense random multigraphs to convergence of the probability measures of the corre- 
sponding random arrays and in Lemma 13.21 we give sufficient conditions under which 
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convergence of dense random multigraphs imply convergence of the degree distribution 
of these graphs. 

We say that a sequence of random infinite arrays (X„)^^ converges in distribution to 

a random infinite array X (or briefly denote X„ ^ X) if x[f ' converges in distribution 
to XW for all keN, i.e. 

^keN, AeAn- lim P(A = XW) =PM = xW) (23) 

If X„ is vertex exchangeable for all n, then X is also vertex exchangeable. 

Let X„ denote a random element of An- We say that the distribution X„ is vertex 
exchangeable if for all permutations t : [n] [n] and B G An 

P(Vz,jgH: B{z,j) = Xn{i,j)) = P(yi,J e[n]: i?(z, j) = X„(r(z), r(j))) , (24) 

that is (X(^,j))-,=i ~ (X(r(^),r(j)))^=i holds. 

If X„ is a random element of An then x|f^ = (-^n(^; j))f j=i is well-defined for k < n, 

thus we might define X„ — ^ X (where X is a random element of Af^i) by fl23|) . It is easy 
to show that if X„ is vertex exchangeable for each ra G N then X inherits this property. 

Also note that by f|T8|) we have X„ — ^ X^i^ if and only if for all G N and for all 
AeAkwe have lim„^oo P (xL''^ = = t={A, W). 

Lemma 3.1. Let X„ = {Xn{i, be a random, vertex exchangeable element of An 

for all n ^N. The following statements are equivalent: 

(a) Xn^W, that is'ik'i Ae Ak- t=(AX„) ^ t={A,W) 

(b) Xn^ Xw, that zs Vfc V A G A : lim„^oo P (xL^' = A^ = t={A, W) 

Proof. We are going to use the fact lim„_j.oo "•("-~^)^-^("~^+^) = i many times in this proof. 
We first prove (a) =^ (6): 

lim P (XlfJ = A) # hm Y: P ((^"(v^(^)' = ^) = 

(/3:[fc]^[n] 

E P((^n(^(^),V^(j)))?,=i = ^) = limE(t=(AX„))^=^t=(AW^) (25) 

Now we prove (6) =^ (a): The idea of this proof comes from Lemma 2.4 of [TO] . 
From (6) we get E(t=(y4,X„)) t=(y4, ly) for all A by the argument used in fl2^ . 
In order to have t=(v4, X„) — ^ ^=(^5 W^) we only need to show 

lim (t=(A, X„)) = lim E (t=(A, Xnf) - t=(A, 1^)^ = 0. 

n— ^oo 71— >oo 
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This follows by the computation 
limE(t=(AXO')i 

lim ^^^^ E P (a = (X„(^(0, ^(j)))L=i ^ ^ = (^"(^(0, ^(J))) -=.+1) ^ 

V5:[2fc]^[n] 

hm P (a = (X„(z, j))t=i , ^ = (^n(^, j))- -=.+1) = 

In the equation (*) we used the fact that X^y is dissociated and (ITSj) . □ 

Recall that for a real- valued nonnegative random variable X we denote E (X; m) := 
E (X ■ 1[X > m]). A sequence of real- valued nonnegative random variables (X„)^^ is 
uniformly integrable (see Chapter 13 of [15]) if 

lim maxE (X„; m) = 0. 

m— )-oo n 

Now we state and prove a lemma in which we give sufficient conditions under which 
X„ ^ X implies -d(Xn,i) D{X,i). Note that some extra conditions are indeed 
needed, because it might happen that very few pairs of vertices of X„ with a huge number 
of parallel edges between them remain invisible if we only sample small subgraphs of X^, 
but still cause a sigificant distortion in the distribution of the degrees of vertices in X„. 
This phenomenon is related to the fact that weak convergence of a sequence of random 
variables X„ — ^ X does not necessarily imply the convergence of the means of X„ to 
that of X: the uniform integrability of (X„)^^ is a sufficient (and essentially necessary) 
condition that rules out pathological behavior. 

Lemma 3.2. 

(i) // (X„)^^ is a sequence of infinite vertex exchangeable arrays, the sequence 
(X„(l, 2))^-,^ is uniformly integrable and X„ X, then for all k E N we have 

(XW, (D(X„,z))ti) ^ (XW, (D(X,.))ti) . (26) 

(a) If is a random, vertex exchangeable element of An for each n G N, X„ — X 
holds for some infinite vertex exchangeable array X and the sequences (X„(l, 1) ] 

V / n=l 
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and ( Xn{l, 2) ) are uniformly integrable then for all k 



n=l 



Xlf], (^irf(X„,0)' J ^ (xW,(Z}(X,0)ti) . (27) 
Proo/. 

Proof of (P: We first prove that (l26l) holds if we further assume P j) < m) = 1 

for some m G N. By the method of moments we only need to show that for all /lij G No, 
^ ^ i ^ j ^ k and Ui G Nq, 1 < i < k we have 

jimE( n Mhjr'^-f[D{^n,tr] = e( n ^(^,jr'^-n^(x,^r). (28) 

\i<j<k 1=1 J \i<j<k i=l / 



For every i G [k] choose J{i) C N such that for all i we have \J{i)\ = Vi and J{i)r\[k\ = 
0, moreover for all i ^ i' we have J(i) fl J{i') = 0. In order to prove (l28i) we first show 
that if P {X{i,j) < m) = 1 for some m G N then 



k \ / k 



\i<j<k 1=1 / y<j<fc j=i jeJ(i) / 

Denote by z/ = Eti^i andz/ := {(^,0 : z G [fc], Z G H} and X^-^ := Ui<j<kXihjY''' ■ 
Using fl2T|) and dominated convergence, the left-hand side of fl29l) is equal to 



iimE(xW'-n(ix:^(^.: 

\ i=l \ j=l 

E E(xw-nnx(.,,(M)) 



A: !/i 



n->-oo n 



liml Y. EfxW'-nnA-(i,,(M))')9 

n^oD n ^ I J. J. J. J. / 

j:!^^[A;..n] \ «=! 1=1 / 

j:u^[k..n] \ i=^j'&J(i) j 

Now the right-hand side of the above equation is easily shown to be equal to the right- 
hand side of (|29|). 

Having established (129|) . our assumptions X„ X and P (X„(i, j) < m) = 1 imply 
the equality f l28p : if we rewrite both the left and the right hand side of fl28p in the form 
corresponding to the right hand side of (12^ , then we only need to check that the expected 
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value of a polynomial function of finitely many values of X„ converge, and this follows 
from the definition of X„ X (for details on see [S]). 

Having established fl26p under the condition P {Xn{i, j) < m) = 1 we now prove 
f l26|) without assuming this condition. If we define the truncated array X"^{i,j) := 

mm{X {i,j),m}, then for each m G N we have X™ X"* from which 

(x-'t^ P(X-,0)ti) ^ (X-'W, {D{X"^,^))^ (30) 

follows by the previous argument. By uniform integrability for every e > there is an m 
such that for all n we have 

E (D(X„, t) - D(X™, t)) ^ E (X(l, 2) - min{X(l, 2), m}) < e. (31) 

It follows from Fatou's lemma that E (-D(X, i) — /^(X™', i)) < s also holds. 
In order to prove fl26l) we only need to check 

Jim E (/ (X|fl, (D(X.,0)ti)) = E (/ (XW, (D(X,.))ti)) 

for any bounded and continuous / : Ak x [0, +00)^^ R. This can be easily proved using 
fl30|) . fl3T|) and the e/3-argument (see Chapter 1.5 of [H]). This finishes the proof of 1^. 

Proof of ([n]): For each n G N let (^7f)^i be i.i.d. and uniformly distributed on [n]. 
Define the infinite array X„ by Xn{i,j) := X„(?7",77p. Now X„ is vertex exchangeable 
and using the vertex exchangeability of X„ we get 

E (X„(l, 2); m) = (1 - ^)E (x„(l, 2); m) + ^E (x„(l, 1); m) , 

end if we combine this with the assumptions of (In]) we get that (X„(l, 2))^-^ is uniformly 
integrable. 

Note that by fl2T]) and the law of large numbers have D(X„,z) = ^(i(X„,?7"). Using 
the vertex exchangeability of X„ we get that the following two (^fc, M^) -valued random 
variables have the same distribution: 

• (x.n\ {D(Xn, 'i))i=i^ under the condition \{rii, . . . , ?7^}| = k 

. (^xW,(id(X„,z))'_J 

Let us call this fact (*). 

X„ — ^ X easily follows from X„ — ^ X, (*) and 

limP(|K,...,r/ai = fc) = l, (32) 

n— >oo 

SO we can apply to obtain (12^ . Now using (*) and again we obtain (1271) . 

□ 
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4 Random urn configurations and edge stationarity 



In this section we define a way of constructing random adjacency matrices using random 
urn configurations (the basic idea comes from Section 3.4 of [5]). This construction relates 
edge stationary random adjacency matrices to ball exchangeable urn models and gives 
an easy proof of Lemma [2.11 using the fact that the distribution of the PAG f^{n,m) and 
that of the stationary state of the edge reconnecting model both arise from the Polya 
urn model via our construction. 

In Subsection 14.11 we prove Theorem [1] and Theorem [2] using this machinery. 

Let n,m E N. A random urn configuration with 2m balls of n different colors is a 
probability distribution on [rajt^'"!, that is a random function : [2m] [n]. If Z G [2m] 
we say that the /'th ball has color Let i) := Yl^i=i ^[^(0 — "^1 ^ ^ M denote 
the multiplicity of color i in 

We say that a random urn configuration \1/ is ball exchangeable if for all permutations 
r : [2m] — > [2m] we have 

(^(0)?ri~(^(r(/)))S. 

\1/ is ball exchangeable if and only if the following property holds: conditioned on the 
value of the type vector (c?(\l/, i))"^^, the distribution of \1/ is uniform on the elements of 
[ri][^™l with this particular type vector, more precisely if ip G [n][^'"l then 



(2m)! 



We say that \1/ is color exchangeable if for all permutations t : [n] ^ [n] we have 
To a random urn configuration \1/ we assign a random element X of by defining 

m 

X{t,j) := 5^ l[^(2e - 1) = 2, ^(2e) = j] + l[^(2e - 1) = j, ^(2e) = t] (33) 

e=l 

for all i,j G [n]. In plain words: the colors of the balls correspond to the labels of the 
vertices and if for any 1 < e < m we see a ball of color i at position 2e — 1 and a 
ball of color j at position 2e then we draw an edge between the vertices i and j in the 
corresponding labeled multigraph (and if i = j then we draw a loop edge at vertex i). 

With the definition fl33p we have P {d(K,i) = (i(\l/,i)) = 1. It is easy to see that all 
probability measures on arise this way. 

If is color exchangeable then X is vertex exchangeable. All vertex exchangeable 
probability measures on A^ arise this way. 
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If \1/ is ball exchangeable then for all B G we have 

where m'{B) denotes the number of non-loop edges. The first term in (I31D is P = i)) 
for some i}) that produces B via (1551) . the second term is the number of elements of [nj^^'"' 
that produce B via (l33i) . 

Recalling the definition of the configuration model (see Section [1]) we can see that 
if we generate X using (1331) from a ball exchangeable urn configuration ^ with a given 
degree sequence {di}^^^ then we in fact uniformly choose one from the the set of possible 
matchings of the stubs where vertex i G [n] has di stubs. Thus (I34p holds for a random 
element X of if and only if the distribution of X is edge stationary. It is easy to 
see that all edge-stationary probability distributions on arise from ball exchangeable 
distributions on [njt^™! via fl33|) . 

Now we define two different dynamics on random urn configurations: 

• The Polya urn model: Fix k G (0, +oo). Let \E'l be a random element of [n]'^'. 
Given ^! i we generate a random element of [ra]'^"^^' which we denote by l+i in 
the following way: let \E'l+i(Z) := li}) for all / G [L] and 

VzG[n]: P(^.+i(L + l)=.|vl/,) = ^^i^^^^ 

^ ' ^ L + UK 

• The ball replacement model: Fix k G (0,+oo). Let be a random element of 
|-j^j[2m]_ Given \E't we generate a random element of [ra]'^"^! which we denote by 
"^T+i in the following way: let C,t denote a uniformly chosen element of [2m]. For 
all / G [2m] \ let *t+i(0 := ^t(0 and 

Vz G M : P (M/^+i(e^) = . I ^t,^t) = ^^^^^ (35) 

It is well-known that if we start with an empty urn and repeatedly apply the Polya 
urn scheme to get for L = 1, 2, . . . , 2m then the distribution of \E'2m is of the following 
form: 

n r=in;iy(^+ j-i 

Thus the distribution of ^^2™ is ball and color exchangeable. The PAGk(^, m) (defined 
in Section [1]) is in fact the random multigraph obtained as the image of the random urn 
configuration (15^ under the mapping (155]) . 

The ball replacement model is an [nj^^™]- valued Markov chain, which is irreducible 
and aperiodic with unique stationary distribution f l36|) : if we delete the .^r'th ball from 



V^GH[^"1: P{^^J,^ = ^l;)= ''';'^'J^^-' ''^ (36) 
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\l/2m5 then by ball exchangeability the distribution of the resulting [n]'^™^^!- valued random 
variable is the same as deleting the 2m'th ball: P61ya-^2m-i- Thus replacing the removed 
^■r'th ball with a new one according to fl35l) we get a [n]'^"^^ -valued random variable with 
P61ya-\E'2m distribution again by ball exchangeability. 

Now consider the ball replacement Markov chain "^t, T = 0, 1, . . . with \E'o being 
an arbitrary [n] [^'"'-valued random variable. If we use the mapping fl55]) to create X(T) 
from "^T, then it is easily seen that the resulting valued stochastic process X(T), 
T = 0, 1, . . . evolves according to the rules of the edge reconnecting Markov chain defined 
in Section [U Some consequences of this fact: 

• If the distribution of \E'o is ball exchangeable then is also ball exchangeable for 
all T, thus if X(0) is edge stationary then X(T) is also edge stationary for all T 
(hence the name "edge stationarity"). 

• The distribution (15^ is stationary for the ball replacement model, thus the image 
of this distribution under the mapping (15^ is the unique stationary distribution of 
the edge reconnecting model. Lemma [2. II follows from (15^ and 



4.1 Limits of edge stationary multigraph sequences 

The key result of this subsection is Lemma 14.11 which can be roughly summarized as fol- 
lows: in a large dense edge stationary random multigraph the number of edges connecting 
the vertices v and w has Poisson distribution with parameter proportional to d{v)d{w). 
Given Lemma 14.11 the proof of Theorem [1] is straightforward and the proof of Theorem 
m reduces to a limit theorem which states that the rescaled number of balls with color 
1, 2, . . . , A; in the Polya urn model converge in distribution to i.i.d. random variables with 
Gamma distribution. 



Lemma 4.1. Let F : [0, +oo) — > [0, 1] denote the cumulative distribution function of a 
nonnegative random variable Z. Let F~^{u) := min{x : F{x) > u}. Let Zi, Z2, . . . be 
i.i.d. random variables with Zi Z F^^{Ui) (where Ui are uniform on [0, 1]). 

If X„ is an An-valued random variable for n = 1,2,..., moreover the distribution of 
X„ is vertex exchangeable and edge stationary, and 



2m(X„) 



p 



n 



2 



p, n — )■ 00, (37) 



where < p < +00 is positive real parameter, moreover for all k & N we have 

-d{Xr„z)) ^(Z,)ti, n^oo (38) 
\^ / i=i 

P 

then X„ — y W where 
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Proof. The infinite random array Xp^/ (see Definition 13. ip can be alternatively defined 
in the following way: Let {X]y{i,j)).^j be conditionally independent given (Zj)^gj^ with 

conditional distribution Xw{i,j) ~ POI (^^) if ^ < J and ~ POI (^). 

If y4 G Ak let A* denote the following modified matrix: A*{i,j) := A{i,j) if i ^ j but 
A*{i,i) := ^^y^. Thus A*{i,i) is the number of loop edges at vertex i. 

Let m[fc] := Define 

p{A, . p) := exp (x: ] • n • n • ■ 2- 

By (dZD and ([21 we have 

p (xS = A I (z.)t,) = nflp (a*(z,,), ;;77(Yfif— ])) = p(^^ iz.)L,P)- 

(40) 

By Lemma 13.11 we only need to show that we have 

WkeN,WAeAk: lim P (X^^l = A) = P f XJ5 = a) (41) 

n—KX) \ / 

in order to prove X„ — ^ W. 

Let ((ij)"=i denote an arbitrary degree sequence with m = ^ Sr=i denote by 

z,:=^, Pn:=—r. (42) 



n V? 



Fix e > and A E Ak- We are going to prove that if 

e<pn< V i G [A;] : z., < e'^ (43) 

then 



p(xW = A|(rf(X„,.))t, = (ci.)li, 



(44) 



p(A(2:i)ti,Pn) + Err(n,A,£) (45) 

with lim„^oo Err(?T,, A, e) = 0. We adopt the convention that the value of Err(n, A, e) 
might change from line to line. 

First we assume that (jS]) = (145|) holds under the condition (H3l) . and deduce (HTj) 
from it. Define the events 5^ and by 

< MXn) ^ ^ ^ irf(X.,z) < e-'} 

n 

■.={e <p< G [A;] : Zi < e~^} 
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Using the Portmanteau theorem and (|57|) . we get that hmsup„_^o^ P (S^) < P (-B^). 



P (XW = A) - P (XS = a) I # |P (XW = A) - E (p (a, , p)) I < (46) 



E pM, -c?(X„,^ 



n 



2m(X„ 



i=l 



; 5j -e(p 



Err(£,An) + (l-P(5^)) 
By dnZD, dSH]), hm„^ooErr(n, = and the fact that p (a, 



li=l ' 



(47) 
(48) 

■ ) is a bounded 



continuous function on the domain fH5]) we obtain 

hmsupdlZ]) < 1 -P(fi^) and hmsup (gHD < 1 - P (S^) . 

n— ^cx) n— >oo 

Now P {B^) — )■ 1 as e — 0, from which fl4ip and the statement of the lemma follows 
under the assumption that implies fHlj) = fH^ . □ 



Proo/o/(i3]) ^ (111 = (11S]).- 

We are using random urn configurations to generate X„. Let denote the ball and 
color exchangeable valued random variable with ((i(\l/, ^))"^]^ = (c?,)"^^, thus \l/„ is 

uniformly distributed on the set of urn configurations with this type vector. X„ can be 
generated from \l/„ via fl33|) . To determine the distribution of Xn we only need to know 
the positions of the balls of color z G [k]. We paint the rest of the balls "grey". Let 



[k] 



1 

-^A(i,j), d[k]-=^di, nig := m - dik] + mik]. 



i=l 



Thus rUg denotes the number of edges of the multigraph spanned by grey vertices. 

In order to prove (jHj) = (H5|) we first give an explicit formula for (144|) . 

The number of grey balls is 2m — d[k]- The number of all urn configurations with type 
vector {di, . . . ,dk, 2m — d[k]) is 

(2m)! 



(49) 

Ul^d^\)■i2m-d[,^)\ 

The number of urn configurations with type vector {di, . . . ,dk, 2m — d[k]) for which 

^1 . 2'"-'^s-E*=i^*(«-«) 



XL'I = Ais 



(50) 



mg\ 
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Thus = Our aim is to prove = fH31) : after dividing both sides of this 

equahty by Y[i<j A*{ijy. ' 2~^»'^**^*'*) we only need to prove 



■(ntirf.!)-(2m-rf[,])!-2^ 



lllM~diA,t)y.-mg\-{2m 

I -1 / 

exp 



(51) 



k \ 2\ k 



^ f E ^0 I ■ n (^^)'^^'' ■ Z'^"'"'' + ^) (52) 



Now we rewrite (IST 



(i5i])= (n w{d,-d{A,i)^i) \ . ( n K+o 



n£|(2m-rf[,] + /) 



^fp- 2m, +2/ \ nlin£f^(c^.-^(AO+o 

11 2m - + / J ■ nri' (2m - m[,] + /) ^''^ 



Now we approximate various terms that appear in the right hand side of fl53|) using 
our assumpions fH3|l : 



<i[fc] 



- f ri ^ 1 ■ + -E-(A .) ) (54) 

JJ (2m - m[fc] + Z) = (2m)"w ■ M + ^Err (A, e) \ (55) 

where < |Err(74, e)! < +oo is independent of n. 

Let d* = mm{di : i E [k], d{A,i) > 0}. We consider two cases separately: 

If d* < n^/^ then using (1151) it is easy to see that flS^ < Err(A, £)r;,~^/^ and also 

p(A, (2»)ti ,Pn) < ETT{A,e)n-^/^, so = holds when rf* < n^/\ 
If (i* > n^/^ then we have 

d(A,i) / k \ / 1 \ 

J] n (rf, - d{A, i) + l)= ( n(rf.)'^(^'^M (^1 + ^Err(A, e) j . (56) 

Putting ( l5l|) . (155|) and (156|) together we get 
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1=1 



2m -I (2m) 



fc \ 2\ k 



exp 



i=i I / i=\ 



This completes the proof of flSTl) = fl52|) . □ 



Proof of Theorem [II Given X„ for every n G N let us define the vertex exchangeable 
random adjacency matrix X„ in the following way: let 7r„ denote a uniformly distributed 
permutation 7r„, : [n] t- [n], independent from X„. Let 

:= (^n(vr„(z),7r„(j))r,=i. (57) 

V / i,j=l 

Then X„ is indeed vertex exchangeable, moreover P ^t=(F, X„) = )f:=(F, X„)j = 1 

for every F G A^, so X„ — ^ W is equivalent to X„ W, which is in turn equivalent 
to X„ 'X.w by Lemma 13.11 By (157|) the conditions (fTTj) and ( 1T2|) are equivalent to 
the uniform integrability of (X„(l,2) j and (Xn(l,l)) , respectively, thus we can 

V / n=l V / n=l 

apply Lemma I3l2]/ flil|) to deduce that for all A; G N 

(^lrf(X„,^)y ^(D(X^,z))ti. (58) 

Note that by (Q, Definition 13.11 and (!22l) we have that {D{'K\Y,i))'^^^ are i.i.d. with 
probability distribution function F]y(^z). 

Now we are going to prove that ^^^i^ ^ p(iy). In order to do so we define 
the truncated adjacency matrix X^ by X^(i,j) := min{X„(i, j), /} and the truncated 
multigraphon W'' which satisfies ~ {m.m{Xw{h 

Now we show that if we fix / G N then p{W^). 



20 



The equations marked by (*) below are true by exchangeability: 
limEfiX:-^(^i>0) limEfirf(Xl,l)) #E(D(X^,1))^P(W^'). 

n-i>oo \n^-~^n I ra-i-oo J 

lim -J2 -dixit) = lim - ^ Gov -diX^t), -di^^ : 

\ i=l / i,j=l ^ 

lim f (^d{Xl 1)) + ^Cov f id(Xi, 1), id(Xi, 2)) ) # 0. 
Having established V/ : ^"^^"^"-^ — ^ p{W^), the relation — ^ p(W^) follows from 



/ 2m(X„) 2m(Xi 



i(TT]i.i[T2)i 



lim p(iy') = p(iy), Ve > : lim sup P |^ — > £ | '"'^^^ 0, 



and the e/3-argument. So conditions (1571) and (1551) are satisfied, thus we can apply 
Lemma [4. II to show that X„ — ^ W^, where W is of form (IT5]) . □ 



Proof of Theorem\^ The distribution ([T^ arises from the P61ya-\E'2^ urn model (I5B1) 
with 2m balls and n colors via (133|) . The distribution ( 1361) is ball and color exchangeable, 
so X„ is vertex exchangeable and edge stationary. If we want to prove Theorem [2] then 
by Lemma [4. II we only need to show that (!38|) holds for all G N where {Zi)^^-^^ are i.i.d. 
with density function g(x, k, ^) (see (ITU]) ). We may use the method of moments to prove 
convergence in distribution, since the Gamma distribution is uniquely determined by its 
moments. Thus we need to show that if z/i, . . . , i/^ G N then 

E f n (^^(^-H, ^)) = E (n zt) = n (9 ■ n + - 1) • 

\j=l ^ ^ / \j=l / i=l j=l 

Fix k and Ui, i E [k]. Let z/ = Yli=i denote hj ip a particular element of [k]^'^^ with 

type vector (z/i, . . . , z/^). By the construction of the P61ya-\I^2m distribution we have 

p (V/ G M : ^ui) = m) = = o{n-n 

Denote hj u := {{i, j) : i G [A;], j G [z/j]}. The number of functions f [2m] with 
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|7^(/)| =N is C((2m(n))^) = 0{n'^^) ii 1 < N < u. 



n^oo fi" ' ^ ' ■ ..-v-/ ■ ■ • • - n— )-oo fi'^ ^ 

,„„ IIk(M!i)^i±i)p (V, e H : = n f^)'" • n + J- - 1) . 

i=l j=l 

The equation (*) holds true by ball exchangeability. □ 
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